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Abstract 

Complexity is an interdisciplinary concept which, first of all, addresses the question 
of how order emerges out of randomness. For many reasons matrices provide a very 
practical and powerful tool in approaching and quantifying the related characteris- 
tics. Based on several natural complex dynamical systems, like the strongly inter- 
acting quantum many-body systems, the human brain and the financial markets, 
by relating empirical observations to the random matrix theory and quantifying 
deviations in term of a reduced dimensionality, we present arguments in favour of 
the statement that complexity is a pheomenon at the edge between collectivity and 
chaos. 
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1 Introduction 



By its very nature, even though central to the contemporary physics, the 
concept of complexity still lacks a precise definition. In qualitative terms this 
concept refers to diversity of forms, to emergence of coherent patterns out 
of randomness and also to some ability of frequent switching among such 
patterns. This normally involves many components, many different space and 
time scales, and thus such phenomena like chaos, noise, but, of course, also 
collectivity and criticality [1]. In fact, due to all those elements, it seems most 
appropriate to search for a real complexity just at the interface of chaos and 
collectivity [2,3]. Indeed, these two seemingly contradictory phenomena have 
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to go in parallel, as they both are connected with existence of many degrees 
of freedom and a strong, often random, interaction among them. 

Approaching complex systems, either empirically or theoretically, is typically 
based on analyzing large multivariate ensembles of parameters. For this rea- 
son, probably the most efficient formal frame to quantify the whole variety 
of effects connected with complexity is in terms of matrices. Since complexity 
is embedded in chaos, or even noise, the random matrix theory (RMT) [4,5] 
provides then an appropriate reference. Its utility results predominantly from 
the fact that the degree of agreement quantifies the generic properties of a sys- 
tem - those connected with chaotic or noisy activity. For the complex systems 
this is expected to be a dominant component, but this component is not what 
constitutes an essence of complexity. From this perspective the deviations are 
even more relevant and more interesting as they reflect a creative and perhaps 
deterministic potential emerging from a noisy background of such systems. 
The main related purpose of the present summary is to identify, within the 
matrix formalism, some principal characteristics of such deviations - the ones 
that are common and typical to natural complex dynamical systems. 



2 Coherence versus noise in matrix representation 

Expressed in the most general form, in essentially all the cases of practical 
interest, the n x n matrices W used to describe the complex system are by 
construction designed as 

W = XY T , (1) 

where X and Y denote the rectangular n x m matrices. Such, for instance, 
are the correlation matrices whose standard form corresponds to Y = X. 
In this case one thinks of n observations or cases, each represented by a m 
dimensional row vector Xj (yi), {i = 1, ...,n) [6], and typically m is larger 
than n. In the limit of purely random correlations the matrix W is then said 
to be a Wishart matrix [7]. The resulting density pw(A) of eigenvalues is 
here known analytically [8], with the limits {\ m in < A < \ ma x) prescribed by 
^min = 1 + l/<5 ± and Q — m/n > 1. The variance of the elements of 

Xj is here assumed unity. 

The more general case, of X and Y different, results in asymmetric correlation 
matrices with complex eigenvalues A. As shown recently [9], such matrices 
also turn out to provide a very powerful tool in practical applications. In 
this more general case a limiting distribution corresponding to purely random 
correlations seems not to be yet known analytically as a function of m/n. The 
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result of ref. [10] indicates however that in the case of no correlations, quite 
generically, one may expect a largely uniform distribution of A bound in an 
ellipse on the complex plane. 

Further examples of matrices of similar structure, of great interest from the 
point of view of complexity, include the Hamiltonian matrices of strongly 
interacting quantum many body systems such as atomic nuclei. This holds 
true [11] on the level of bound states where the problem is described by the 
Hermitian matrices, as well as for excitations embedded in the continuum. 
This later case can be formulated in terms of an open quantum system [12], 
which is represented by a complex non-Hermitian Hamiltonian matrix. Several 
neural network models also belong to this category of matrix structure [13]. 
In this domain the reference is provided by the Gaussian (orthogonal, unitary, 
symplectic) ensembles of random matrices with the semi-circle law for the 
eigenvalue distribution [5]. For the irreversible processes there exists their 
complex version [14] with a special case, the so-called scattering ensemble [15], 
which accounts for ^-matrix unitarity. 

As it has already been expressed above, several variants of ensembles of the 
random matrices provide an appropriate and natural reference for quantifying 
various characteristics of complexity. The bulk of such characteristics is ex- 
pected to be consistent with RMT, and in fact there exists strong evidence that 
it is. Once this is established, even more interesting are however deviations, 
especially those signaling emergence of synchronous or coherent patterns, i.e., 
the effects connected with the reduction of dimensionality. In the matrix termi- 
nology such patterns can thus be associated with a significantly reduced rank 
k (thus <C n) of a leading component of W. A satisfactory structure of the 
matrix that would allow some coexistence of chaos or noise and of collectivity 
thus reads: 

W = W r + W c . (2) 



Of course, in the absence of W r , the second term (W c ) of W generates k 
nonzero eigenvalues, and all the remaining ones (n — k) constitute the zero 
modes. When W r enters as a noise (random like matrix) correction, a trace 
of the above effect is expected to remain, i.e., k large eigenvalues and the 
bulk composed of n — k small eigenvalues whose distribution and fluctuations 
are consistent with an appropriate version of random matrix ensemble. One 
likely mechanism that may lead to such a segregation of eigenspectra is that 
m in eq. (1) is significantly smaller than n, or that the number of large com- 
ponents makes it effectively small on the level of large entries w of W. Such 
an effective reduction of m (M = m e ff) is then expressed by the following 
distribution P(w) of the large off-diagonal matrix elements in the case they 
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are still generated by the random like processes [11]: 



\wr-m K(M _ 1)/2{H) 



where K stands for the modified Bessel function. Asymptotically, for large w, 
this leads to P{w) ~ exp(— \w\) \w\ M ^ 2 ^ 1 , and thus reflects an enhanced prob- 
ability of appearence of a few large off-diagonal matrix elements as compared 
to a Gaussian distribution. As consistent with the central limit theorem the 
distribution (3) quickly converges to a Gaussian with increasing M. 

Another mechanism that may lead to a structure analogous to (2), is the pres- 
ence of some systematic trend, in addition to noise, in the X and Y matrices. 
Then [16], to a first approximation, the second term in this decomposition is 
represented just by a matrix whose all entries are close in magnitude, and thus 
its rank is directly seen to be unity. The most straightforward indication that 
this kind of decomposition applies is an asymmetric shift of P(w) relative to 
zero. 

Based on several examples of natural complex dynamical systems, like the 
strongly interacting Fermi systems, the human brain and the financial markets, 
below we systematize evidence that such effects are indeed common to all the 
phenomena that intuitively can be qualified as complex. 



3 Common features of complexity in natural systems 



Since it was nuclear physics which gave birth to several concepts relevant to 
the physics of complex systems, in particular to RMT, we begin with an issue 
which originates from nuclear considerations and which, at the same time, 
addresses a problem [17] of great current interest, attracting lot of activity 
in the literature. More specifically, the related question asks what is a nature 
of the ground state if the two-body interaction is drawn from a Gaussian 
ensemble. This is an example of a sparser connectivity than just everything 
with everything and by this it is more realistic. 

In the presence of two-body interactions the many-body Hamiltonian matrix 
elements v J a a , of good total angular momentum J in the shell-model basis \a) 
generated by the mean field, can be expressed as follows [18]: 

<*' = E <#*g£- ( 4 ) 
j'u' 

The summation runs over all combinations of the two-particle states \i) cou- 
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pled to the angular momentum J 1 and connected by the two-body interaction 
g. The analogy of this structure to the one schematically captured by the 
eq. (2) is evident. gf v denote here the radial parts of the corresponding two- 
body matrix elements while cj?$ globally represent elements of the angular 
momentum recoupling geometry. gf v are drawn from a Gaussian distribution 
while the geometry expressed by Cj"" enters explicitly. An explicit calculation 
then shows [11] that for J > the tails of P(v) are very nicely reproduced by 
the eq. (3) with M ~ 2. This originates from the fact that a quasi-random cou- 
pling of individual spins results in the so-called geometric chaoticity [19] and 
thus cj??>' coefficients are also Gaussian distributed. In this case, these two (g 
and c) essentially random ingredients lead however to an order of magnitude 
larger separation of the ground state from the remaining states as compared 
to a pure RMT limit, and this is consistent with the above estimate for M. 
Due to more severe selection rules the effect of geometric chaoticity does not 
apply for J = 0. As a consequence, in this particular case P(v) is much closer 
to a Gaussian, i.e., M is here much larger. Consistently, the ground state en- 
ergy gaps measured relative to the average level spacing characteristic for a 
given J is larger for J > than for J = 0, and also J > ground states are 
more orderly than those for J = 0, as it can be quantified in terms of the 
information entropy [16], for instance. 

Interestingly, such reductions of dimensionality of the Hamiltonian matrix can 
also be seen [20] locally in explicit calculations with realistic (non-random) nu- 
clear interactions. A collective state, the one which turns out coherent with 
some operator representing physical external field, is always surrounded by 
a reduced density of states, i.e., it repells the other states. It is also appro- 
priate to mention at this point that similar effects of reduced dimensionality, 
applicability of the formula (3), and of the resulting segregation of states one 
observes [21-23] in the many body quantum open systems due to the coupling 
to continuum. Of course, in the latter case on the complex plane. In all those 
cases, the global fluctuation characteristics remain however largely consistent 
with the corresponding version of the random matrix ensemble. 

Recently, a broad arena of applicability of the random matrix theory opens 
in connection with the most complex systems known to exist in the universe. 
With no doubt, the most complex is the human's brain and those phenom- 
ena that result from its activity. From the physics point of view the financial 
world, reflecting such an activity, is of particular interest [24] because its char- 
acteristics are quantified directly in terms of numbers and a huge amount of 
electronically stored financial data is readily available. An access to a sin- 
gle brain activity is also possible by detecting the electric or magnetic fields 
generated by the neuronal currents [25]. With the present day techniques of 
electro- or magnetoencephalography, in this way it is possible to generate the 
time series which resolve neuronal activity down to the scale of 1 ms. 
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One may debate over what is more complex, the human brain or the financial 
world, and there is no unique answer. It seems however to us that it is the 
financial world that is even more complex. After all, it involves the activity of 
many human brains and it seems even less predictable due to more frequent 
changes between different modes of action. Noise is of course owerwhelming 
in either of these systems, as it can be inferred from the structure of eigen- 
spectra of the correlation matrices taken across different space areas at the 
same time [26,27,16], or across different time intervals [9,28]. There however 
always exist several well identifiable deviations, which, with help of reference 
to the universal characteristics of the random matrix theory, and with the 
methodology briefly reviewed above, can be classified as real correlations or 
collectivity. An easily identifiable gap between the corresponding eigenvalues 
of the correlation matrix and the bulk of its eigenspectrum plays the central 
role in this connection. The brain when responding to the sensory stimula- 
tions develops larger gaps than the brain at rest [9]. The correlation matrix 
formalism in its most general asymmetric form allows to study [9] also the 
time-delayed correlations, like the ones between the oposite hemispheres. The 
time-delay reflecting the maximum of correlation (time needed for an informa- 
tion to be transmitted between the different sensory areas in the brain [29,30]) 
is also associated with appearance of one significantly larger eigenvalue. Sim- 
ilar effects appear to govern formation of the heteropolymeric biomolecules. 
The ones that nature makes use of are separated by an energy gap from the 
purely random sequences [31]. 

As far as the dynamics of evolution of complex systems is concerned one 
interesting observation made in [16], based on the stock market evolution, is 
also to be pointed out in the present context. It appears that increases, as a 
rule, are more competitive, and thus less collective than decreses which are 
always accompanied by a more violent collectivity. This may illustrate a more 
general logic of evolution of natural complex dynamical systems. 

Such characteristics of coherence are typically connected with a few largest 
eigenvalues of the correlation matrix and those eigenvalues stay significantly 
above \ max - The bulk of eigenvalues is quite universally consistent with the 
RMT limit. There exist however some more subtle measures of eigenvalue 
fluctuations in the random matrix theory. In particular, we refer here to the 
Tracy- Widom law [32] which, based on Painleve representations and a proper 
scaling of eigenvalues, provides a general formalism to study fluctuations of 
individual eigenvalues. An appropriate rescaling of eigenvalues makes this law 
applicable also to Wishart matrices [33]. Motivated by this formalism, and 
based on the high frequency recordings of all the stocks comprised by DAX, 
we recently analysed the fluctuations of various eigenvalues of the correlation 
matrix using our methodology [16] of moving time-window. Even though, on 
average, the distribution of the bulk of eigenvalues is here consistent with 
the RMT limit, significant deviations relative to fluctuations of eigenvalues 
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of the correlation matrices calculated from purely random time series still 
remain. This can partly be attributed to the effect reminiscent of the slaving 
principle of synergetics [34] : if one, or a small fraction of states take the entire 
collectivity, all the others become enslaved and thus their 'noise freedom' gets 
also reduced. This may affect the oposite edge of the spectrum by suppressing 
the amount of noise there, and thus making the corresponding states again 
deviating more from their RMT limit. The above seems to provide a likely 
explanation for the effect observed in ref. [27], that the smallest eigenvalues of 
the financial correlation matrix also correspond to more localised states. Such 
effects seem to constitute another manifestation of complexity. 



4 Summary 

The above brief review tempts to view complexity as a trinity comprising 
coherence, chaos and a gap (probably not too large) between them. Coherence 
constitutes the essence as it makes patterns and structures, which is of primary 
interest and importance. Chaos is always present in any really interesting 
system and, in fact, it is even needed as it allows to quickly explore the whole 
available phase space, and thus to probe various possibilities and to switch 
from one pattern of activity to another. Finally, the gap between them allows 
the structures to be identifiable and to exist for some time. Thus all the three 
are needed in parallel. Such a combination probably makes a natural system 
most efficient in its evolution. 

This work was partly supported by KBN Grant No. 2 P03B 097 16 and by 
the German-Polish DLR scientific exchange program, grant No. POL-028-98. 



References 

[1] H.E. Stanley, Rev. Mod. Phys. 71 (1999) S358. 

[2] S.A. Kauffman, The Origins of Order-Self-Organization and Selection in 
Evolution, Oxford University Press, Oxford, 1993. 

[3] P. Bak, How Nature Works-the Science of Self-Organized Criticality, Springer- 
Verlag, New York, 1996. 

[4] E.P. Wigner, Ann. Math. 53 (1951) 36. 

[5] M.L. Mehta, Random Matrices, Academic Press, Boston, 1991. 

[6] R.J. Muirhead, Aspects of Multivariate Statistical Theory, John Wiley & Sons, 
New York, 1982. 



7 



[7] J. Wishart, Biometrica 20A (1928) 32. 

[8] A. Edelman, SIAM J. Matrix Anal. Appl. 9 (1988) 543; A.M. Sengupta, 
P.P. Mitra, Phys. Rev. E 60 (1999) 3389. 

[9] J. Kwapieri, S. Drozdz, A. A. Ioannides, Phys. Rev. E 62 (2000) 5557. 

[10] H.J. Sommcrs, A. Crisanti, H. Sompolinsky, Y. Stein, Phys. Rev. Lett. 60 (1988) 
1895. 

[11] S. Drozdz, M. Wojcik, Physica A 301 (2001) 291. 
[12] I. Rotter, Rep. Prog. Phys. 54 (1991) 635. 
[13] J.J. Hopfield, Proc. Natl. Ac. Sci. USA 79, 2554(1982). 
[14] J. Ginibre, J. Math. Phys. 6 (1965) 3. 

[15] V.V. Sokolov, V.G. Zelevinsky, Nucl. Phys. A 504 (1989) 562. 

[16] S. Drozdz, F. Griimmer, A.Z. Gorski, F. Ruf, J. Speth, Physica A 287 (2000) 
440. 

[17] C.W. Johnson, G.F. Bertsch, D.J. Dean, Phys. Rev. Lett. 80 (1998) 2749. 

[18] I. Talmi, Simple Models of Complex Nuclei, Harwood Academic Publishers, 
New York, 1993. 

[19] T. Ericson, Adv. Phys. 9 (1960) 425. 

[20] S. Drozdz, S. Nishizaki, J. Speth, M. Wojcik, Phys. Rev. E 57 (1998) 4016. 

[21] W. Iskra, M. Miiller, I. Rotter, J. Phys. G 19 (1993) 2045 

[22] S. Drozdz, J. Okolowicz, M. Ploszajczak, I. Rotter, Phys. Rev. C 62 (2000) 
024313. 

[23] S. Drozdz, A. Trellakis, J. Wambach, Phys. Rev. Lett. 76 (1996) 4891. 

[24] R.M. Mantegna, H.E. Stanley, An Introduction to Econophysics: Correlations 
and Complexity in Finance, Cambridge University Press, Cambridge, 1999. 

[25] M. Hamalainen, R. Hari, R.J. Ilmoniemi, J. Knuutila, O. Lounasmaa, Rev. 
Mod. Phys. 65 (1993) 413. 

[26] L. Laloux, P. Cizeau, J.-P. Bouchaud, M. Potter, Phys. Rev. Lett. 83 (1999) 
1467. 

[27] V. Plerou, P. Gopikrishnan, P. Rosenow, L.A.N. Amaral, H.E. Stanley, Phys. 
Rev. Lett. 83 (1999) 1471. 

[28] S. Drozdz, J. Kwapieh, F. Griimmer, F. Ruf, J. Speth, Physica A, 299 (2001) 
144. 

[29] J. Kwapieh, S. Drozdz, L.C. Liu, A. A. Ioannides, Phys. Rev. E 58 (1998) 6359. 



8 



[30] A. A. Ioannides, L.C. Liu, J. Kwapieri, S. Drozdz, M. Streit, Human Brain Map. 
11 (2000) 77. 

[31] CD. Sfatos, E.I. Shakhnovich, Phys. Rep. 288 (1997) 77; 

N.V. Dokholyan, E.I. Shakhnovich, J. Mol. Biol. 312 (2001) 289. 

[32] C.A. Tracy, H. Widom, Commun. Math. Phys. 177 (1996) 727. 

[33] I.M. Johnstone, Ann. Stat. 29 (2001) 295. 

[34] H. Haken, Advanced Synergetics, Springer, Berlin, 1987. 



9 



